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ABSTRACT. Coupled nonlinear Schrodinger systems describe some physical phe- 
nomena such as the propagation in birefringent optical fibers, Kerr-like photore- 
fractive media in optics and Bose-Einstein condensates. In this paper, we study 
the existence of concentrating solutions of a singularly perturbed coupled non- 
linear Schrodinger system, in presence of potentials. We show how the location 
of the concentration points depends strictly on the potentials. 



1. Introduction 

Very recently, different authors focused their attention on coupled nonlinear 
Schrodinger systems which describe physical phenomena such as the propaga- 
tion in birefringent optical fibers, Kerr-like photorefractive media in optics and 
Bose-Einstein condensates. 

First of all, let us recall that, in the last twenty years, motivated by the study 
of the propagation of pulse in nonlinear optical fiber, the nonlinear Schrodinger 
equation, 

-Am + u = u 3 in R 3 , 

has been faced by many authors. It has been proved the existence of the least en- 
ergy solution (ground state solution), which is radial with respect to some point, 
positive and exponentially decaying with its first derivatives at infinity. More- 
over there are also many papers about the semiclassical states for the nonlinear 
Schrodinger equation with the presence of potentials 

-e 2 Au + V(x)u = u 3 in IR 3 , 

giving sufficient and necessary conditions to the existence of solutions concen- 
trating in some points, and recently, in set with non-zero dimension, (see e.g. 
[4-8, 13, 15, 16, 20, 21, 27, 28, 30, 31]). 

However, by LP. Kaminow [19], we know that single-mode optical fibers are 
not really "single-mode", but actually bimodal due to the presence of birefrin- 
gence. This birefringence can deeply influence the way in which an optical evolves 
during the propagation along the fiber. Indeed, it can occur that the linear bire- 
fringence makes a pulse split in two, while nonlinear birefringent traps them to- 
gether against splitting. C.R. Menyuk [25, 26] showed that the evolution of two 
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orthogonal pulse envelopes in birefringent optical fibers is governed by the fol- 
lowing coupled nonlinear Schrodinger system 



(1.1) 



with f3 positive constant depending on the anisotropy of the fibers. System <(TTTJ> 
is also important for industrial applications in fiber communications systems [17] 
and all-optical switching devices [18]. If one seeks for standing wave solutions of 
fll.l|) , namely solutions of the form 



</>(x, t) = e iw ^u{x) and if){x, t) = e iw ^v(x), 
then Jl.ll l becomes 



(1.2) 



-u xx + u = \u\ 2 u + P\v \ 2 u in 
-v xx + w 2 v = \v\ 2 v + [3\u\ 2 v in 



with w 2 = w\jw\. Finally we want to recall that dl.21) describes also other physical 
phenomena, such as Kerr-like photorefractive media in optics, (cf. [1,10]). 

Problem ()1.2|) . in a more general situation and also in higher dimension, has 
been studied by R. Cipolatti & W. Zumpichiatti [11,12]. By concentration com- 
pactness arguments, they prove the existence and the regularity of the ground 
state solutions (u,v) ^ (0,0). Later on, in two very recent papers, T.C. Lin & 
J. Wei [22] and L.A. Maia, E. Montefusco & B. Pellacci [24] deal with problem 
()1.2|) . also in the multidimensional case, and, among other results, they prove the 
existence of least energy solutions of the type (u, v), with u, v > 0. Moreover 
T.C. Lin & J. Wei [22] prove that, if (3 < 0, then the ground state solution for (|1.2|) 
does not exist. We refer to all these papers and to references therein for more 
complete informations about dl.2l l. 

Another motivation to the study of coupled Schrodinger systems arises from 
the Hartree-Fock theory for the double condensate, that is a binary mixture of 
Bose-Einstein condensates in two different hyperfine states |1) and |2) (cf. [14]). 
Indeed these phenomena are governed by the following system: 

— e 2 Au + Ai« = fi\u 3 + (3uv 2 in Q, 

—e 2 Av + X 2 v = fi 2 v 3 + (3u 2 v in Q, 

u, v > in Q, 

u = v = on dQ, 



(1.3) 



where is a bounded domain of R 3 . Physically, u and v represent the correspond- 
ing condensate amplitudes, e 2 = with h the Planck constant and m the atom 
mass. Moreover fj,j = —(Nj — l)Ujj and (3 = —N 2 Ui2, with N 3 ^ 1 a fixed number 
of atoms in the hyperfine state \ j), and Uij = Aw—a^, where dj/s and a i2 are the 
intraspecies and interspecies scattering lengths. Besides, by E. Timmermans [29], 
we infer that fij = fxj (x) represents a chemical potential. For more informations 
about (11.3b , see [22,23] and references therein. 
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T.C. Lin & J. Wei, in [23], studied problem (11.3b with Ai, A 2 , fa, fa positive con- 
stant and they proved that if (3 < yjfafa, for e sufficiently small, (11.31) has a least 
energy solution (u £ ,v £ ). Moreover, they distinguished two cases: the attractive 
case and the repulsive one. In the attractive case, which occurs whenever (5 > 0, 
u £ and v £ concentrate respectively in Q £ and Q' £ , with 

\Qe-Q' £ \ 



0, as e —y 0. 



Precisely they proved that 



d(Q £1 dVi) — > maxd(Q, dil), 
d(Q' £ ,dty -> max d(Q,dn). 

In the repulsive case, that is when (3 < 0, the concentration points Q £ and Q' e 
satisfy the following condition: 

<f(Qs,Q' £ ) -> max ^(Q,^), 
(Q,Q')e^ 2 

where 

^(Q, Qf) = min{ v/aTIQ - Q'|, v^lQ " Q'l, V^Q, <9fi), VMd(Q', dSl)}. 
In particular 

> oo, as e — ► U. 

£ 

Motivated by these results and by the fact that we know that fa may be not 
constants (cf. [29]), in this paper we study the following problem: 

— e 2 Au + Ji(x)u = J 2 {x)u 3 + (3uv 2 inQ, 

— e 2 Av + Ki(x)v = K 2 {x)v 3 + (3u 2 v in Q, 

u, v > in fl, 

u = v = on dQ, 



with f2 C M 3 , possibly unbounded and with smooth boundary, and with j3 < 0, 
namely in the repulsive case. We will show that the presence of the potentials 
change drastically the situation with respect to the case with positive constants 
for what concerns the location of peaks, but, in some sense, not the repulsive na- 
ture of the problem. In fact, with suitable assumptions on the potentials, for e 
sufficiently small, we will find solutions (u e ,v E ) of \P £ \ , even if not of least en- 
ergy, concentrating respectively on Q £ and Q' £ which tend toward the same point, 
determined by the potentials, as e — > 0, but with the property that the distance 
between them divided by e diverges (see Remark ll.2|l 

Up to our knowledge, in this paper we give a first existence result of concen- 
trating solutions for problem ( |7^] >, in presence of potentials. 

On the potentials Jj and Ki we will do the following assumptions: 

(J) for % — 1, 2, Ji e C X (Q, R), Ji and DJi are bounded; moreover, 

Ji(x) ^ C > for all x G Q; 
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(K) for i = 1, 2, Ki G C 1 (fi, R), -fTj and DK { are bounded; moreover, 

^ C > for all x G Q. 

Without lost of generality, we can suppose that there exists e > 0, such that 
Q := Q, n (n - e e x ) ± 0, where e x = (1, 0, 0). 

Let us introduce an auxiliary function which will play a crucial role in the study 
of $P £ [ . Let T : fi — ► K be a function so defined: 

(1.4) r(Q) = MQ^MQ)- 1 + /^ 1 (Q)^ 2 (g)- 1 . 

Let us observe that by (J) and (K), T is well defined. 
Our main result is: 

Theorem 1.1. Suppose (J) and (K) and (3 < 0. Lei Q £ ^ #w isolated local strict 
minimum or maximum of T. There exists e > such that if < e < e, then ( |7^T > 
possesses a solution (u E , v £ ) such that u £ concentrates in Q £ with Q £ — > Q , as e — ► 0, 
and v £ concentrates in Q' £ with Q' £ — > Q / fl s e — > 0. 

Remark 1.2. Let us observe that, by the proof it will be clear that, even if 

\Q e -Q' £ \^0, ase^O, 

we have 

> oo, as e — ► (J. 

£ 

Let us present how Theorem ll.ll becomes in some particular situations. 
Let H : Vt — ► R satisfying the assumption: 

(H) i/ G C 1 ^, R), if and Dif are bounded; moreover, 

H(x) > C > for all ar G fi. 

Corollary 1.3. Suppose (H) and /3 < 0. Suppose, moreover, that we are in one of the 
following situations: 

• all the potentials Ji and Ki coincide with H; 

• there exists i — 1, 2 such that J io = H and K io = H,for i = i , while J { and K { 
are constant for i ^ i ; 

• all the potentials Ji and Ki are constant, except only one, which coincides with 
H. 

Let Q G f2o be an isolated local strict minimum or maximum of H. There exists e > 



such that ifO < e < e, then (fPl|) possesses a solution (u £ ,v £ ) such that u £ concentrates 
in Q £ with Q £ — > Q , as e — > 0, and v £ concentrates in Q' £ with Q' £ — > Q , as e — > 0. 

Remark 1.4. If instead of (3 constant, we consider (3 G C 1 (f2, R), bounded and bounded 
above by a negative constant, then we have exactly the same results. 

Finally, we want to observe that we can treat also a more general problem than 
tfPs} . Let us consider, indeed, 

-e 2 A« + J x (x)u = J 2 (x)u 2p - 1 + (3u p - l v p in Q, 



(V £ ) 



-s 2 Av + K x (x)v = K 2 {x)v 2p - 1 + puPyP' 1 in Q, 
u, v > in Q, 

m = v = on dQ, 
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with Q C Mr, possibly unbounded and with smooth boundary, iV ^ 3, 2 < 2p < 
2N/(N - 2) and with (3 < 0. 

Also in this case, without lost of generality, we can suppose that there exists 
e > 0, such that := fin (fi - e ei) ^ 0, where ei = (1, 0, . . . , 0) £ R N . 

Let us define now T: fi — > M be a function so defined: 

— p N 1 p N 1 

In this case, Theorem II .ll becomes: 

Theorem 1.5. Let N ^ 3 and 2 < 2p < 2N/(N - 2). Suppose (J) and (K) and /3 < 0. 

Lei Q ^ fio ^ fln isolated local strict minimum or maximum oft. There exists e > 
such that if0<e<e, then possesses a solution (u E , v £ ) such that u £ concentrates 
in Q e with Q e — > Q , as e —> 0, and v e concentrates in Q' £ with Q' e —> Q , as e — >• 0. 

Remark 1.6. Let us observe that, ifp = 2 and N = 3, then Theorem Wl\ is nothing else 
than a particular case o/Theorem \1.5\ Nevertheless, since problem ( fP^l * is more natural 
and more important by a physical point of view, we prefer to present Theorem Wl\ as our 
main result and to prove it directly, showing how, with slight modifications, the proof of 
Theorem \1.5\ follows. 

Theorem II .11 will be proved as a particular case of a multiplicity result in Sec- 
tion 5 (see Theorem 15.11 1 . The proof of the theorem relies on a finite dimensional 
reduction, precisely on the perturbation technique developed in [2,3,7]. In Sec- 
tion 2 we give some preliminary lemmas and some estimates which will be useful 
in Section 3 and Section 4, where we perform the Liapunov-Schmidt reduction, 
making also the asymptotic expansion of the finite dimensional functional. Fi- 
nally, in Section 5, we give also a short proof of Theorem II .51 

Notation 

• We denote fi := fi fl (fi — e ei), where e\ = (1, 0, 0) and e is sufficiently 
small such that fi 

• If r > and x £ R 3 , B r (x ) := {x E R 3 : \x - x \ < r}. We denote with B r 
the ball of radius r centered in the origin. 

• If m: R 3 -»• MandP £ M 3 ,wesetu P := u{- - P). 

• If e > 0, we set Q e := Q/e = {x £ R 3 : ex £ Q}. 

• We denote H e = H^{Q e ) x H^{Q £ ). 

• If there is no misunderstanding, we denote with || • || and with (• | •) respec- 
tively the norm and the scalar product both of Hq (fl e ) and of H £ . While we 
denote with || ■ || R s and with (• | -) R 3 respectively the norm and the scalar 
product of H l (R 3 ). 

• With Ci and c ir we denote generic positive constants, which may also vary 
from line to line. 
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2. Some preliminary 
Performing the change of variable x i— > erx, problem $P £ \ becomes: 



(2.1) 



—Am + Jx(ex)u = J 2 (ex)u 3 + (3uv 2 = in £l e , 

—Av + Ki(ex)v = K 2 (ex)v 3 + /3u 2 v = in fl £ , 

u, v > in f2 e , 

it = v = on dQ F 



where £l £ = e' 1 ^. Of course if (u, v) is a solution of (|2.1|l , then (u(-/e),v(-/e)) is a 
solution of ( fPT] l. 

Solutions of J2.ll! will be found in 



endowed with the following norm: 

IIK^)llw £ = IMI^(fi e ) + ll v llifi(n«)' for a11 G 

If there is no misunderstanding, we denote with || ■ || and with (• | •) respectively 
the norm and the scalar product both of H 1 ^^ and of TC £ . 

Solutions of ()2.1|l are critical points of the functional f £ : H £ — > R, defined as 

fe(u,v) = -[ \Vu\ 2 + )- f Ji{ex)u 2 - \ [ J 2 (ex)u 4 



2 



2 2 



If we define // : H^(Q £ ) -> R and /* : iZj(fi e ) -> R as 



we have 



/e(«,«) = //(tt)+/f(«)-f / «V. 



Furthermore, for any fixed Q 6 H, we define the two functionals Fq : _ff 1 (R 3 ) 
and Fg : # X (R 3 ) -> R, as follows 



Fn (u 



~ / \Vu\ 2 + \! UQW-- I HQ)u\ 

z Jm. 3 1 Jm.3 4 Jr3 

Fq{v) = \! \Vv\ 2 + \j Kl {Q)v 2 -- j K 2 (Q)v\ 

Z JR* Z J R 3 4 J R 3 
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The solutions of ()2.1|l will be found near (U Q , V Q ), properly truncated, where 
U Q is the unique solution of 

( -Au + J x (Q)u = J 2 (Q)u 3 in R 3 , 

(2.2) I u > in IR 3 , 

^ u(0) = max R 3 u, 

and Vq is the unique solution of 

f -At; + ^ 1 (g)t; = K 2 (g)t; 3 inM 3 , 

(2.3) I v > in M 3 , 

^ w(0) = max K 3 v, 

for an appropriate choice of Q G Oo- It is easy to see that 

(2.4) u Q (x) = v / JiiMi ■ w (v^MQ) • z) , 

(2.5) V Q (x) = v / ^i(Q)/^ 2 (Q) • W (v^M ■ , 
where W is the unique solution of 

{-Az + z = z 3 inIR 3 , 
^>0 inR 3 , 
z(Q) = max R 3 z, 

which is radially symmetric and decays exponentially at infinity with its first 
derivatives (cf. [16,20]). 

For all Q G £l , we set Q' = Q'(e, Q) = Q + \fee\ G Vt and moreover we call 
p = p( £ , Q) = Q/e G Q e and P' = P'(e, Q) = Q'/e G Q e . Let us observe that 

(2.7) |P - P'\ = — -»• 0, as £ -f 0. 

v e 

Let x : M 3 ^ IR be a smooth function such that 

= 1, for |x| ^ e~ 1//4 ; 

X(x) = 0, for |x| ^ 2s- 1 / 4 ; 

0^x(x)^l, for e- 1 / 4 ^ |xK 2£- 1 / 4 ; 

|Vx(x)| ^2s 1 /\ for^ 1 / 4 < |a;| < 2£~ 1 / 4 . 

We denote 

(2.9) E7>(a;) := x(x - P) U Q (x - P) , 

(2.10) Vp/(a;) := xfa - i*) V°(a; - i*). 

Let us observe that (Up, Vp>) G H £ . For Q varying in Q , (Up, Vp>) describes a 
3-dimensional manifold, namely, 

(2.11) Z s = {(U P ,V p/ ):QeQ }- 

Remark 2.1. 0/ course, ifVl = R 3 , then Q = R 3 and we do noi need to truncate U Q 
and V Q . In this case, we would have simply U P = U Q (- — P) and V P > = V Q (- — P'). 



(2.8) 
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First of all let us give the following estimate which will be very useful in the 
sequel. 

Lemma 2.2. For all Qeflo and for all e sufficiently small, if Q' = Q + \fee\, P = 
Q/s eVt £ and P' = Q'/e G Q e/ then 



(2.12) / UpV^, = o(e). 



Proof Let us start observing that, since 

\p - P '\ = £ -V2 > 4£ -l/4 ; 

we infer that 

B 2£ - 1/i (P)UB 2£ - 1/ ,(P')=$. 

Therefore, by the definitions of ()2.9|) and l|2.10|l and by the exponential decay of 
Up and Vpi, we get 



/ £/|V*, < [ {U Q )\x-P){V Q )\x-P') 

<c x / {V Q )\x-P') 

Jr s \b 2£ _ 1/4 (p') 

+ c 2 [ {U Q )\x-P) = o{e). 



'R3\B 2e _ 1/4 (p) 

This concludes the proof. □ 

In the next lemma we show that the 3-dimensional manifold Z £/ defined in 
(|2.11|) , is actually a manifold of almost critical points of f £ . 

Lemma 2.3. For all Q e fi and for all e sufficiently small, if Q' = Q + y/eei, P = 
Q/s e£l £ and P' = Q'/e e fi e , then 

(2.13) \\Vf £ (Up,V P ,)\\ = 0(e 1 ' 2 ). 
Proof For all (u, v) e H £ , we have: 

{Vf £ {U P , Vp>) | (u, v)) = [ [VU P ■ Vw + J x (ex)U P u - J 2 {ex)Upu] 

+ / [VV P/ -Vv + K^ex^v - K 2 (ex)V^ f v] 

(2.14) -13 f U P V 2 ,u-f3 [ UpVp.v. 
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Let us study the first integral of the right hand side of l)2.14|) . By the exponential 
decay of U Q and recalling that is solution of ()2.2|) , we get 

/ [VU P - Vu + J x {ex)U P u- J 2 (£x)U P u] 

[VU Q ■ Vm_ p + J x (sx + Q)U q u-p] 

(U~Q)/enB s _ 1/4 

J 2 (ex + Q) (U Q )\^ P +o(e) 

(n-Q)/enB £ _ 1/4 

VU Q ■ Vm_p + Ji{ex + Q)U Q u_ P - J 2 (ex + Q) (U Q ) u-p + o(e) 

3 



(2.15) 



VU Q ■ Vtt-p + Ji(Q)f/ Q M_ P - J 2 (Q) (U Q ) u_p 
+ [ (j 1 (ex + Q)-J 1 (Q))U Q u^ P 
- / {J 2 (ex + Q)- J 2 (Q)) {U Q )\^ P + o(e) 

JR* 

/ (J 1 (ex + Q)-J 1 (Q))U Q u_ P 

-/ {J 2 (ex + Q)-J 2 (Q))(U Q )\^ P + o(e). 
Jr 3 



Moreover, from the assumption D Jj bounded, we infer that 

\Ji(ex + Q) - Ji(Q)\ ^ cie\x\, 

and so, 

/ (Uex + Q)- Ji{Qj)U Q u-p^\\u\\( I \.h(ex + Q)- .h(Q)\ 2 \U Q \' 



1/2 



(2.16) 



Analogously, 



(2.17) 



1/2 



0(e)||«||. 



(J 2 ( £ x + Q) - J 2 (Q)) (U Q f u^ P = 0{e)\\u\ 



Therefore, by (12.151) , (12.161) and l|2.17|l , we infer 

(2.18) I [VU P ■ Vu + Ji{ex)U P u - J 2 (ex)Upu] = 0(e 



)N 
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Similarly, since V Q is solution of (12.31) , we get 

/ [VVp, ■ Vv + Kt^Vprv - K 2 (ex)V^v] 

= [ (K 1 {ex + Q + ^e 1 )-K 1 {Q))V Q v^ p/ 
Jr 3 

(2.19) - / (K 2 (ex + Q + y/iej) - K 2 {Q)) (V Q f V- P , + o(e). 

Jr 3 

Therefore, from the assumption DKi bounded, we infer that 

\Ki(ex + Q + y/eei) - Ki(Q)\ ^ c 2 y/e\^/ex + e\\, 

and so, 

/ (^(ear + Q+Viei) - K^{Q))V Q V- P , 

< II v || ( / (^(ex + g + V^ei) - ATxCQ)! 2 !^! 

(2.20) ^c 2 |M| ^y^i^x + dH^i 2 ^ 7 =0(e 1 / 2 )|| 

Analogously, 

(2.21) / (K 2 (ex + Q + y/iej - K 2 (Q)) (V Q )\^ P> = 0(e 1 / 2 )\\v\\. 
Jr 3 

Therefore, by dZ19b . (l2~20b and d2~2Tt . we infer 

(2.22) f [VV P ,-Vv + K l {ex)Vp,v-K 2 {Ex)Vl„v\=0{E 1/2 )\\v\\. 

Let us study the last two terms of ()2.14|) . Arguing as in Lemma l2~2l we get 



1/2 



V\\. 



(2.23) 

and 
(2.24) 



UpV^u 



<c 3 



ufv*! 3 



3/4 



\u\\ = o[e) « 



( e )||«||. 



Now the conclusion of the proof easily follows by l|2.14|l , ()2.18|> , l|2.22|) , ()2.23|l and 
dZ24l) . ' ' □ 



3. INVERTIBILITY OF £> 2 / £ ON (T^y^Z 6 ) 1 

In this section we will show that D 2 f e is invertible on (T(u p y pl )Z e ) , where 
T(Up,v pl )Z £ denotes the tangent space to Z £ at the point (Up, V P >). 

LetL £i g : ^T{u P ,v P ,)Z e ) x — > (T( Up y p ,- ) Z £ ) ± denote the operator defined by setting 

(L £tQ (h,'ti) | (k, k')) — D 2 f £ (U P , V P ')[(h, h'), (k, k')\. 



COUPLED NONLINEAR SCHRODINGER SYSTEMS WITH POTENTIALS 11 

Lemma 3.1. Given fi > 0, there exists C > such that, for e small enough and for all 
Qen with \Q\ ^ jj,, one has that 

(3.1) \\L £ , Q (h,ti)\\>C\\(h,ti)\\, V(h,h') e {T {Up y pl) Z^. 
Proof First of all, let us observe that, for all (h, h'), (k, k') e H £ , we have 

(3.2) D 2 f £ (u,v)[(h,h'),(k,k')] = D 2 f £ J (u)[h,k] + D 2 f^(v)[h',k'} 

-P [ v 2 hk-2f3 [ uvhk' -2(3 [ uvh'k-(3 [ u 2 h'k'. 
Jq e Jq e Jq e Jn £ 

By (Q, if we set a(Q) = ^Ji(Q)/J 2 (Q) and b(Q) = y/Ji{Q), we have that 
(jQ(x) = a(Q)W(b(Q)x) and so U P (x) = x{x - P)a(eP)W(b(eP)(x - P)). There- 
fore, we have: 

d Pi U P {x) = 8 Pi ( X (x - P)U Q (x - P)) 

= - U Q (x - P)d XiX (x -P) + x(x - P)d Pt U Q (x - P) 

= - U Q (x - P)d XtX (x -P)+ e X (x - P)d Pi a{eP)W{b{eP){x - P)) 

+ e X (x - P)a(eP)d P .a(eP)VW(b(eP)(x - P)) ■ (x - P) 

- x (x - P)a{eP)b(eP)(d Xi W){b(eP)(x - P)). 

Hence 

(3.3) d Pi U P (x) = -d Xi U P (x) + 0(e). 
Analogously, we can prove that 

(3.4) d Pi V P ,{x) = d P ,y P ,{x) = -d Xi Vp,{x) + 0{e). 
We recall that 

T (u P ,v P ,)Z £ = span H£ {(d Pl U P , d Pl V P >), (d P2 U P , dp 2 V pl ), (dp 3 U P , d Ps V p/ )}. 
We set 

V £ = span ne {(U P , V P >), (d xl U P ,d Xl V P >), (d X2 U P ,d X2 V P >), (d X3 U P ,d X3 V P >)}. 

By (13.31 1 and (13.4b , therefore it suffices to prove equation d3.ll ) for all (h, h!) £ 

span Hs {(U P , Vp>), (0, 0')}, where (0,0') is orthogonal to V £ . Precisely we shall 
prove that there exist Ci,C 2 > such that, for all e > small enough, one has: 

(3.5) (L £ ,q(U p , V P ,) | (Up, V P ,)) < - C x < 0, 

(3.6) (L £ , Q (0, 0') | (0, 0')) ^ C 2 1| (0, 0') f, for all (0, 00 JL V £ . 
PROOF OF d3~5l By d3~2l . we get: 

(3.7) D 2 f £ (U P , V PI )[(U P , V P ,), (Up, VpO] 

= D 2 f £ J (Up)[U P , Up] + D 2 /* (VpO[Vp', V P ,] -6(3 [ U 2 V 2 ,. 
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Let us study the first term of the right hand side of J3.7I I. 

D 2 f £ J (Up)[Up,U P }= [ \VU P \ 2 + [ J^ex^-S f J 2 (ex)U P 
Jn E Jn e Jn e 

J [\VU Q \ 2 + J^ex + Q) {U Q ) 2 - 3J 2 (ex + Q) (U Q )' 
(n-Q)/ E aB e _ 1/4 
+ o(e) 



\VU Q \ 2 + MQ) (U Q ) - 3J 2 {Q) (U Q ) 

+ [ (Mex + Q) - J X (Q)) (U Q ) 2 

-3 [ (J 2 (ex + Q) - J 2 (Q)) (U Q ) 4 + o(e) 

= -2 / J 2 {Q) (U Q ) 4 + 0(e) 

= -2J 1 (Q) 1 2j 2 (Q)- 1 [ W 4 + 0(e)^- Cl . 

Jr 3 

In a similar way it is possible to prove that 

D 2 fK(V pl )[V pi ,V P >] ^-c 2 . 
Finally, by Lemma l2~2l we know that 

I U 2 V 2 ,=o(e), 

and so equation (13.51 1 is proved. 



PROOF OF <\3.6l . Recalling the definition of x> ( see <E78|>), we set xi '■= X an d 
X 2 '■= 1 — Xi- Given (0, 0') _L V £ , let us consider the functions 

(3.8) 0,(x) = X ,(x-P)0(x), 2 = 1,2; 

(3.9) ( p' t (x) = x t (x-P')4 > \x), 2 = 1,2. 

With calculations similar to those of [7], we have 

(3.10) |M| 2 =||^iir + ||0 a || 2 + 2 / XiX^ + m^+OieV^M 2 , 

V ■ v ' 

h 

(3.11) ||0 / || 2 =||0 / 1 || 2 + ||0 , 2 || 2 + 2 f XiX 2 ((0') 2 + I V0f) +0(s^W\\ 2 . 

* ' 

V 



COUPLED NONLINEAR SCHRODINGER SYSTEMS WITH POTENTIALS 13 

We need to evaluate the three terms in the equation below: 

(£ £ ,q(0,0') I (0,0')) = ( L e,Q(<f>l, 0'l) I (01, 0l)) + {Le,Q{<f>2, 2 ) I (02,02)) 

(3-12) + 2(^(0!, 0i) I (0 2 ,0' 2 )). 

Let us start with (L £) q(0 1; 0' x ) | (0 1; 0^)). Since j3 < 0, we get 

(L e , O (01,#) | (01,00) = ^ 2 //(^p)[01,0l] +^ 2 /f (VpO[0'l,0'l] 

- 4/3 / UpVp^ - (3 [ U 2 ^ 2 -f3 [ V 2 P 4\ 
> D 2 //(f/p)[0i,0i] + D'f^Vp,)^^} 

(3.13) -A(3 f UpVpxj)^. 
Arguing as in Lemma I2~2l we know that 

(3.14) f UpV P 4i'P' 1 = o{e). 

Therefore we need only to study the first two terms of the right hand side of 
J3.13I I. For simplicity, we can assume that Q = eP is the origin O. In this case, 
we recall that we denote with U° the unique solution of (12.21 1 whenever Q = O, 
while we denote with Uq the truncation of U° , namely Uq = x U° , where x is 
defined in (12.8ft . We have 

D 2 f £ J (U )[<piAi}= [ D V <^| 2 + Ji(ex)<Pl-3J 2 (ex)U 2 <p 2 } 

JCl s 

= J D 2 F^)(f/°)[0 1 ,0 1 ] 
+ / (Ji(ea;)- Ji(0))<p\ 

-3 / {J 2 {ex) - J 2 {0)) (U°) 2 2 + o(e)||0|| 2 

> D 2 F^°\U°)\^H ~<%ej |x|0 2 + O(e)||0|| 2 
= J D 2 F^)( f /°)[0 1 ,0 1 ]+O(. 3 / 4 )||0|| 2 , 

therefore 

(3.15) D 2 fJ(Uo)[4>x, 0i] > D 2 F J( - \U°)[(j) 1 , 0i] + O(£ 3 / 4 )||0|| 2 . 
We recall that is orthogonal to 

Vf = spau H i (ne) {t/ ,9 a;i ?7o,9 a!a t7' ,9 (B 3E/o}. 
Moreover by [9], we know that if is orthogonal to V with 

V 17 = span^^iC/ ,^^ ,^^ ,^^ }, 



|V0i| 2 + Ji(£x)0 2 -3J 2 (ea;) (£/' 
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then the fact that U° is a Mountain Pass critical point of F J( -°^ implies that 
(3.16) D 2 F J (°\U°)&4>} >c 4 ||0|| 2 3 forall^XV 17 . 

We can write 4 = t + G where £ eV u and ( _L V^ 7 . More precisely 

e = (01 I f/°||^|| R 3 2 + ][>1 I ^^) R 3 ^C/°||^^||-3 2 . 

1=1 

Let us calculate (0i | t/ )^ 3 . By the exponential decay of U° and since _L V^, 
we have 

(0i I U°)^ = [ V0! • W° + / 0iZ7° 

JR 3 JR 3 



V0i ■ VC/ + / faUo + o(e 
/ V0-Vf/ o + / 0[/ o + O ( £ )||0|| =o(e 



In a similar way we can prove also that (0i | d Xi U°)^3 = o(e)||0||, and so 
(3-17) ||e|| R 3 = o( £ )||0||, 

(3.18) HCIlH» = IMI + °(e)|M|. 
Let us estimate D 2 F J{ -°\U°)[<j>x, 0i]. We get: 

EPF J V\U°)[M X \ = D 2 F J ( \U ){(,(] + 2D 2 F J ( \U°)l(,Z] 

(3.19) +D 2 F^°\U°)[i^}. 
By (l3~T6l and d3~TB1> . since C -L V 77 , we know that 

D 2 F J W(U°)[(X] > c 3 \\C\\ls = c 3 \\M 2 + o(e)U\\ 2 , 
while, by 13.171 and straightforward calculations, we have 

D 2 F^\U°){C,Z] = o(e)U\\ 2 , 
D 2 F^\U°)[^] = o{e)U\\ 2 . 
By these last two estimates, (13.191) and (13.151) , we can say that 
D 2 //(^a)[0i,0i] >c 4 ||0 1 || 2 + O(e 3 / 4 )||0|| 2 . 
Hence, in the general case, we infer that, for all Q6fl with \Q\ < jj,, 

(3.20) D 2 //(C/p)[0i, 0i] > c 4 ||0i|| 2 + O(e 3 / 4 )||0|| 2 , 
and, analogously, 

(3.21) D 2 f^(V p/ )[ ( p[A[}>c^' 1 \\ 2 + 0(e 1 / 2 )U'\\ 2 . 
By (l3~T3l . d3~14ll . d3~2"Ub and (l3~2Tl . we can say that 

(3.22) (L £ , Q (0 1 ,0' 1 ) | >c 6 ||(0 1 ,0' 1 )|| 2 + O(e 1 / 2 )||(0,0' 1 )|| 2 . 
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Let us now evaluate (Z/ £i q(0 2 , 0' 2 ) I (02,02))- Arguing as in Lemma 12.21 since 
(3 < and using the definition of x% and the exponential decay of Up and of Vp>, 
we easily get: 

(L e , Q (0 2 ,0 2 ) I (02,0 2 )) = £> 2 //(^p)[02,0 2 ] + J D 2 /f (Vp>M,<f>' 2 ) 



4(3 [ UpVprfc^ 



(3 1 Ul^-(3 



> D 2 f E J (U P ) [0 2 , 2 ] +D 2 f«(V P ,) [0 2 ,0' 2 ] + (e)|| (0,0') || 2 
(3.23) ^c 7 ||(02,02)ir + o(e)||(0,0 / )|| 2 . 

Let us now study (L £j q(0i, 0' x ) | (0 2 , 0' 2 )). Arguing as in Lemma |2~21 we get 

(L E)O (0i,0i) | (02,0' 2 )) = £>V/(^F)[01,02] + £>Vf (VpO[0'l,02] 

-2(3 f UpVpxj)^ -2(3 f UpVpi^x 
-(3 [ UUU'-P [ vUi 



P<PlV2 ~ h> / V P>VW2 

(3.24) -13 f t^0i02- P f ^0102 + 0(5)11(0,0') II 2 - 

Using the definition of \i an d the exponential decay of Up and of Vp>, we easily 
get: 

(3.25) D 2 //(t/p)[0i,0 2 ] ^CsI^ + Oie^UW 2 , 

(3.26) D 2 /f (YrMM > c^ + Oie^U'W 2 , 

where 1$ and 1$ are defined, respectively in (|3.10|l and (|3.11|) . Moreover, by the 
definition of x> ( see <EBJ)/ and by the definitions of 0j and 0-, (see ()3.8|l and (|3.9|) ), 

0i (x) 2 (x) = x(x - P){1 ~ X(x - P))<P 2 {x) > 0, for all x e M 3 , 
and so, also 

0i(x) 02 (x) ^ 0, for all x£R 3 . 

Therefore 

(3.27) -/? / U 2 P ^ 2 - (3 [ Vj,0!0 2 > 0. 
By (l3~24l . d3~25l) . d3~26l) and (l3~27ll . we infer 

(3.28) (L e>Q (0 1 ,0 , 1 ) | (0 2 ,0 2 )) ^c 10 (^ + V) + O(£ 1/4 )||(0,0OI| 2 - 
Hence, by d3J2l . d3~22b . (l3~23b . (l3~28l and recalling (l3~TuT> and d3lll . we get 

(L £jQ (0,0O I (0,00) ^c 11 ||(0,0O|| 2 + O( £ 1 /4 ) || (0)0 ')|| 2 . 
This completes the proof of the lemma. □ 
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4. The finite dimensional reduction 

By means of the Liapunov-Schmidt reduction, the existence of critical points of 
f £ can be reduced to the search of critical points of an auxiliary finite-dimensional 
functional. 

Lemma 4.1. Fix // > 0. For e > small enough and for all Qe(] with \Q\ ^ /i, there 
exists a unique (w, w') = (w(e, Q),w'(e, Q)) e H £ of class C 1 such that: 

(1) (w(e,Q),w'(e,Q)) G (T^,^,)^; 

(2) Vf e (U P + w, V P , + w') e % p , yp ,)Z e . 
Moreover, the functional A £ : fi — ► K-/ defined as: 

MQ) ■= fe(U Q /e + w(e, Q), V {Q+eiV - £)/£ + w'{e, Q)) 

is of class C 1 and satisfies: 

VA £ (Qo) = ^ V/ e (C/ Qo/£ + Q ), V {Qo+eiy r £)/£ + w'{e, Q )) = 0. 

Proof Let V = V £i q denote the projection onto (T(u p y ^Z 6 ) 1 . We want to find 
a solution (w, w') e (T( C / p y p ,)2' e )" L of the equation 

PV/ e (f/p + w,V P / +w') = 0. 

One has that 

Vf £ (U P + w, V P , + w') = Vf e (U P , V pl ) + D 2 f £ (U P , V pl )[w, w'} + R(U P , V P >, w, w') 

with || R(U P , V P f, w, w') || = o(||(w, w') ||), uniformly with respect to (U P , V P /). There- 
fore, our equation is: 

(4.1) L EiQ (w,w') +VVf e (U P ,V pi ) +VR(U P ,V pl ,w,w') = 0. 
According to Lemma |3~TI this is equivalent to 

(w,w') = N s>Q (w,w'), 

where 

N EiQ (w,w') = -{L £>Q y 1 (VVf £ (U P ,V p/ ) +VR(Up,V p ,,w,w')). 
By (I2TT31 it follows that 

(4.2) \\N ejQ (w,w>)\\ =0(s^) + o(\\(w,w')\\). 

Therefore it is easy to check that N £:Q is a contraction on some ball in (T( Up y ) Z £ ) L 
provided that e > is small enough. Then there exists a unique (w, w') such that 
(w,w') = N £ ^q(w,w'). Let us point out that we cannot use the Implicit Func- 
tion Theorem to find (w(e, Q), w'(e, Q)), because the map (e, u, v) 1— > Wf e (u, v) 
fails to be C 2 . However, fixed e > small, we can apply the Implicit Function 
Theorem to the map (Q,w,w') 1— > Wf e (U P + w,V P > + w'). Then, in particu- 
lar, the function (w(e, Q),w'(e, Q)) turns out to be of class C 1 with respect to Q. 
Finally, it is a standard argument, see [2, 3], to check that the critical points of 
A e (Q) = f e (Up + w, Vp> + w') give rise to critical points of f £ . □ 
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Remark 4.2. From (14.21 * it immediately follows that: 

(4.3) \\(w,w')\\=0(e^). 

Let us now make the asymptotic expansion of the finite dimensional functional. 

Theorem 4.3. Fix // > and let Qefi with \Q\ ^ fi,Q' = Q+ \fee\, P = Q/e eVl £ 
and P' = Q'/e G fi e . Suppose (J) and (K). Then, for e sufficiently small, we get: 

(4.4) A(<2) = fe {Up + w(e, Q), V P . + w'(e, Q)) = c T(Q) + o^ 1 / 4 ), 
where T : Q — > R is defined in 9jlA) . namely 

r(Q) = MQ^MQ)- 1 + *Ti(Q)^ 2 (<3r\ 

and 



Co 



(4.5) 

w;#/z unique solution of (12.6ft . 

Proof We have: 

=/ e (E/p + w(e, Q), Vp, + w'(e, Q)) 



IT 



|V(t/ P + w)| 2 + - / J 1 (ex)(£7 P + w) 



+ i/ \V{V P , + w')\ 2 + \f K 1 (sx){V pi + w'Y -- [ K 2 (ex)(V P ,+w') 
^Jn E ^Jn E 4Jn E 

~~ f {Up + w)\V p , + w') 2 . 
1 Jn E 



Therefore, by (14.31) and Lemma |2~2"I 



MQ) 



\vu P \ 2 + 



J x {ex)Ul 



J 2 (ex)U P 



\\ \VV P ,\ 2 + l -f K x {ex)Vl„ -\ f K 2 (ex)V* +0{e^) 



(4.6) =fi{U P ) + ff{Vp.) + 0{^ 2 ). 

Let us study the first term of the right hand side of (14.6 

fe(Up) = l[ \VU P \ 2 + U MexW 2 - 1 - [ J 2 



l 

2 



(n-Q)/er\B _ 1/4 



[ex)Uj 



\VU Q \ 2 +.h(ex + Q) (U Q f- -J 2 (ex + Q) {U Q )' 



0(6 
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+ 



U j 1 {Q){u q ) 2 --J HQ){u Q y 

(J^ex + Q) - Ji(Q)) (f/Q) 2 
(J 2 (ez + Q)- J 2 (Q)) (U^Y + o(s) 



Hence 
(4.7) 

Analogously, 



1 JR3 



f: ( V PI ) = \j |W P f + i / K^V*, - - ! K 2 (ex)V* 

= \ J \\W Q \ 2 + K 1 (ex + Q') (V Q f 
(n-Q')/enS e _ 1/4 

-1 I ^ 2 (ea; + g')(^) 4 + o(5) 
(n-Q')/enB E _ 1/4 

=4/ |V^| 2 + i/ Kl {Q){V Q ) 2 --J K 2 {Q){V Q ) 1 



+ i / (^(ez + Q + y/i ei ) - K X {Q)) (V Q ) 2 

1 JR3 

- \ [ (K 2 (ex + Q + Vie 1 )-K 2 (Q))(V Q ) i + o(e) 
1 7r3 

= \k x {Q)^K 2 {Q)- 1 [ W* + o(e 1 /*). 
1 Jrs 

Therefore 

(4.8) f J £ {V pl ) = ^K 1 (Q)^K 2 (Q)~ 1 [ W A + ( e V*). 

* JR3 

Now (l4~4l follows immediately by d4~6b . (gTJ and (Ob . 



□ 
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5. A MULTIPLICITY RESULT AND PROOFS OF THEOREMS 



In this section we give the proofs of our theorems. First of all, let us prove 
Theorem II .11 as an easy consequence of the following multiplicity result: 

Theorem 5.1. Let (J) and (K) hold and suppose T has a compact set X c f2 where T 
achieves a strict local minimum (resp. maximum), in the sense that there exist 5 > and 
a 5 -neighborhood X$ C fi of X such that 



b := inf{r(Q) : Q G dX s } > a := T ]x , (resp. sup{r(Q) : Q G dXg} < T\ x ) . 



Then there exists e > such that has at least cat(X, Xg) solutions that concen- 
trate near points of X S/ provided e G (0,e). Here cat(X, Xs) denotes the Lusternik- 
Schnirelman category of X with respect to Xg. 

Proof First of all, we fix \i > in such a way that \Q\ < fi for all Q e X. We will 
apply the finite dimensional procedure with such \x fixed. 

We will treat only the case of minima, being the other one similar. We set Y = 
{Q G Xg : A £ (Q) ^ c (a + b)/2}, being c defined in (g3J. By (Q it follows that 
there exists s > such that 



On the other side, if Q G Y then A e (Q) ^ c (a + b)/2. Hence, for e small, Y cannot 
meet dX s and this readily implies that Y is compact. Then A £ possesses at least 
cat(F, Xs) critical points in X s . Using J5.ll ! and the properties of the category one 
gets 



Moreover, by Lemma 14.11 we know that to critical points of A E there correspond 
critical points of f £ and so solutions of ()2.1|l . Let Q £ G X be one of these critical 
points, if Q' £ = Q £ + ^fe e lf then 



(5.1) X c Y C X s , 

provided e G (0, e). Moreover, if Q G dXs then T(Q) ^ b and hence 
MQ) > c T(Q) + o(e^ 4 ) ^ c b + o(e l ' A ). 



cat(y,F) ^ c&\,{X,X s ). 



(«?',«?•) = (U Qs/£ + w(e,Q £ ),V Q , /£ + w'(e,Q £ )) 



is a solution of ()2.1|l . Therefore 




is a solution of fP^ and also the concentration result follows. 



□ 



Let us now give a short proof of Theorem II .51 
Proof of Theorem 11.51 We need only to observe that, in this case, the solutions 
of $P £ \ will be found near (U Q , V Q ), properly truncated, where U Q is the unique 
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solution of 

-Au + J x {Q)u = J 2 (Q)u 2p - 1 in R N , 
u>0 inR N , 
w(0) = max R jv u, 

and Vq is the unique solution of 

-Av + K x {Q)v = K 2 (Q)v 2p - 1 inR N , 
v>0 inR N , 
v(0) = max R iv v, 

for an appropriate choice of Q e £l . It is easy to see that 

U Q {x) = (Ji(Q)/J 2 (Q)) 1/M • W (VMQ) ■ x) 

= (^(g)/ir 2 (g)) 1/(2p - 2) • w (VKjjQ) ■ 

where W is the unique solution of 

-Az + z = z 2v ~ x in R N , 
z>0 in R N , 

z(0) = max K iv z. 

At this point, we can repeat the previous arguments, with suitable modifications. 

□ 



x 



Remark 5.2. Of course, the analogous of Theorem \5.1\ holds also for problem $P^\ . 
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